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Abstract 

Problem Statement. The educational technology standards for teachers set 
by the International Society for Technology in Education (the ISTE 
Standards-T) represent an important framework for using technology 
effectively in teaching and learning processes. These standards are widely 
used by universities, educational institutions, and schools. The 
contemporary ISTE standards for teachers proposed in 2008 have five 
dimensions. The standards created a vision for the educational technology 
field, so it is important that how prospective teachers or in-service teachers 
meet these standards is measured with valid and reliable instruments. 

Purpose of the Study : The purpose of this study was to develop and validate 
the education technology standards self-efficacy (ETSSE) scale, which is 
based on the ISTE Standards-T. 

Method: Confirmatory factor analyses (CFA) were conducted in order to 
determine the factor structure of the scale. The scale items were 
constructed based on the ISTE Standards-T and performance indicators. 
To define the content validity values of the scale items, the researchers 
asked the opinions of 12 specialists. The data was collected from 
prospective teachers (CFA1 group, n=473) and teachers (CFA2 group, 
n=394). Owing to the theoretical structure of the standards being defined 
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by ISTE, both first order and second order confirmatory factor analyses 
were applied to the datasets of the two groups separately and without 
exploratory factor analysis. 

Findings: The ETSSE scale was validated in five dimensions as ISTE 
Standards-T 2008 identified. According to the results of the first order and 
second order confirmatory factor analyses (CFAs) of the two different 
groups, the scale is considered reliable (CFA1 1 st order [y 2 (734, n= 473)= 
1857.23, p< .001, RMSEA=.057, SRMR=.053, NFI= .95, NNFI=.97, CFI=.97, 
IFI=.97]; CFA2 1st order [y 2 (727, n= 394)= 1886.31, p< .001, RMSEA=.064, 
SRMR=.056, NFI = .95, NNFI=.97, CFI=.97, IFI=.97]). Concurrent validity 
results showed a positive and significant correlation between the two 
scales .83 (p<.01). Cronbach's Alpha was at .95 and McDonald's Omega 
was .96. The item analyses showed that each item correlated with the 
overall score from the scale both for prospective teachers and teachers 
(Corrected Item-Total Correlation >.30). Independent group t-tests for the 
27% upper and 27% lower groups in the five sub-factors showed 
significant difference (p<.01). 

Conclusion and Recommendations: The research results have demonstrated 
that the developed ETSSE scale consisting of 40 items and five subscales is 
valid and reliable for both teachers and prospective teachers. 

Keywords: Education technology standards, ISTE standards, scale 
development, confirmatory factor analysis 


Introduction 

Predictions suggest that qualified educational institutions with international 
standards will be replacing institutions lagging behind in near future (Ozcan, 2013). 
Studies using current theoretical frameworks identify skills as standards that 
students, teachers, and administrators should have, and effective use of information 
and communications technology (ICT) is widely considered to be a basic skill in the 
21st century (Voogt & Roblin, 2010; Voogt & Roblin, 2012). 

Training the teachers who are in key position of integrating ICT in instructional 
processes (Kabakci & Odabasi, 2007; Ilgaz & Usluel, 2011; Kabakci Yurdakul, 2013; 
Goktas, Yildirim & Yildirim, 2009) is just as important as equipping educational 
institutions with the proper technological resources (Akpinar, 2003). The 
International Society for Technology in Education (ISTE) has been carrying out 
international level research on the standardization of educational technology skills 
for using technology effectively in education for different groups (students, teachers, 
and administrators). ISTE emphasizes the effective use of technology in educational 
settings and sets standards for the integration of technological knowledge, 
pedagogical knowledge, and content knowledge into courses. ISTE has provided 
certain standards and performance indicators for teachers and prospective teachers 
for using technology, especially in instructional processes and in teaching subject 
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areas (ISTE, 2014; Seferoglu, 2009; Coklar & Odabasi, 2009; Morphew, 2012). The 
ISTE Standards-T represent an important framework for using technology effectively 
in teaching and learning processes and are widely used by universities, educational 
institutions, and schools (ISTE, 2000). Performance indicators in the standards are 
specific, measurable outcomes that assess what teachers should be able to do to show 
that they have achieved competency in the standard (Morphew, 2012). 

According to the ISTE Standards-T proposed in 2008, teachers should be able to: 

1. Facilitate and inspire student learning and creativity. Teachers use their 
knowledge of subject matter, teaching and learning, and technology to facilitate 
experiences that advance student learning, creativity, and innovation in both face-to- 
face and virtual environments. 

2. Design and develop digital age learning experiences and assessments. 
Teachers design, develop, and evaluate authentic learning experiences and 
assessments incorporating contemporary tools and resources to maximize content 
learning in context and to help students develop the knowledge, skills, and attitudes 
identified in the ISTE standards. 

3. Model digital age work and learning. Teachers exhibit knowledge, skills, and 
work processes representative of an innovative professional in a global and digital 
society. 

4. Promote and model digital citizenship and responsibility. Teachers 
understand local and global societal issues and responsibilities in an evolving digital 
culture and exhibit legal and ethical behavior in their professional practices. 

5. Engage in professional growth and leadership. Teachers continuously 
improve their professional practice, model lifelong learning, and exhibit leadership 
in their school and professional community by promoting and demonstrating the 
effective use of digital tools and resources (ISTE, 2014). 

These standards can be taken as 21 st century teacher competencies (ISTE, 2014). 
Because digital learners demand digital teaching, competent teachers who meet the 
requirements of these learners should be trained to international standards (Skoretz 
& Cottle, 2011; Ozcan, 2013). In the modern transformation of the education system, 
it is important to deal with effective technology integration models in the classroom 
and to configure the curriculum accordingly. Thus, appropriately customizing 
curriculum to meet the international standards will provide a positive contribution to 
the teacher training policies. 

As theoretical constructs of the ISTE Standards-T that cannot be observed 
directly, the aforementioned standards should be tested on both prospective teachers 
and in-service teachers to determine reliability and validity. The purpose of this 
study is to develop and validate the five-factored structure of the education 
technology standards self-efficacy (ETSSE) scale based on the ISTE Standards-T. 
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Method 

Participants 

The research study groups consist of junior (third year) and senior (fourth year) 
prospective teachers (Confirmatory Factor Analysis - CFA1 group; n= 473) studying 
at a faculty of education of a state university, and teachers (CFA2 group; n= 394) at 
secondary or high schools in the center districts of Diyarbakir during the spring 
semester of the 2014-2015 academic year in Turkey. A total of 510 surveys were 
distributed to prospective teachers, 480 appropriate responses were obtained, and 
473 (for the CFA1 group) of them were used in the data analysis process. Similarly, 
431 forms were distributed to the in-service teachers, 408 of whom completed the 
forms precisely, resulting in 394 (for the CFA2 group) observations that were taken 
into account in the data analysis process. 

Table 1. 


Demographic Characteristics of the Participants in CFA1 and CFA2 Groups 


CFA1 (Prospective Teachers) 

f 

% 

CFA2 (Teachers) 

f 

% 

U 

O) 

Female 

277 

58.6 

U 

<D 

Female 

151 

38.3 





£ 




CD 

u 

Male 

196 

41.4 

<D 

U 

Male 

243 

61.7 


Preschool Ed. 

79 

16.7 


Physical Ed. 
Information 

15 

3.8 


Elementary Ed. 

32 

6.8 


technology 

17 

4.3 


Foreign language 

31 

6.6 


Science and 

96 

24.5 


(English) 


math fields 


Social studies 

82 

17.3 


Arts 

13 

3.3 


Turkish language and 
literature 

34 

7.2 


English 

33 

8.4 


c/i 

-M 

r* 

Geography 

31 

6.6 


Vocational and 
technical fields 

35 

8.9 

<D 

g 

4—* 

u 

Oh 

Secondary mathematics 

16 

3.4 

C/1 

Music 

7 

1.8 

Turkish 

37 

7.8 

u 

0 

5h 

PQ 

Psychological 
counseling and 

14 

3.6 

Q 

Physics 

11 

2.3 

guidance 

Health 

education 

2 

0.5 


Chemistry 


28 5.9 


Social science 
fields 


137 34.9 


Biology 27 5.7 

Philosophy 29 6.1 

Pedagogical formation 
mathematics 


Technology 
and design 

Others 7 1.8 


36 7.6 
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Table 2. Continued 

CFA1 (Prospective Teachers) 

f 

% 

CFA2 (Teachers) 

f 

% 

*53 Junior (3rd year) 

> 

Ja Senior (4th year) 

241 

232 

51 

49 

School 

Stage 

Secondary 
High School 

239 

155 

60.7 

39.3 

§ Faculty of education 

342 

72.3 

60 u 

G G 

1-5 year 

6-10 year 

65 

93 

17.1 

24.5 

bb Pedagogical formation 

131 

27.7 

rG -r 
u ft 

11 -15 year 

102 

26.8 

u 

Ph 



S a 
H x 

16-20 year 

72 

18.9 





20 year up 

48 

12.6 


The demographic characteristics of the prospective teachers (the CFA1 group) 
indicate that the majority of the participants were female (58.6%), the participation of 
junior and senior level prospective teachers was very close (49% and 51%, 
respectively), and the number of prospective teachers registered in the pedagogical 
formation program (27.7%) was much lower than those in the education program 
(72.3%). The CFA1 group, which involved 13 different departments, had the most 
respondents from the Social Studies department (17.3%) and the least from Physics 
(2.3%). 

In the CFA2 group comprising of in-service teachers, there were more male 
teacher (61.7%) respondents than female teachers, secondary school teachers (60.7%) 
were more than high school teachers, and teachers from 34 different branches 
grouped into 12 overarching branches participated in the research. The most 
participation was by social science fields' teachers (34.9%). 

Research Instrument and Procedure 

Based on the purpose of the scale, the related literature initially reviewed and an 
item pool generated from the ISTE Standards-T. Some items were eliminated based 
on lack of clarity, questionable relevance, or undesirable similarity to other items. 
The next step in the process was asking a group of specialists in the content area to 
review the item pool. This review serves multiple purposes for maximizing the 
content validity of the scale (DeVellis, 2003). The scale, which was designed in 
accordance with experts' opinions, was a five point likert type: Strongly Disagree (1), 
Disagree (2), Mildly Agree (3), Agree (4), and Strongly Agree (5). The ETSSE 
questionnaire consisted of 40 items and five sub-dimensions, took 8-10 minutes to 
complete, and had no reverse scoring items. The sub-scales of the ETSSE scale are: 
(FI) Facilitating and inspiring student learning and creativity; (F2) Designing and 
developing digital age learning experiences and assessments; (F3) Modelling digital 
age work and learning; (F4) Promoting and modelling digital citizenship and 
responsibility; and (F5) Engaging in professional growth and leadership. 

Data Analysis 

Owing to the theoretical structure of the standards defined by ISTE, both first and 
second order confirmatory factor analyses were applied to the datasets of the CFA1 
and CFA2 groups separately to define construct validity without exploratory factor 
analysis (EFA). In EFA, the underlying latent variable structure is not known. Thus, 
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the focus of the investigation is directed toward uncovering the minimal number of 
factors that underlie the observed variables. In CFA, on the other hand, the 
researcher has some knowledge of the underlying latent variable structure (Byrn, 
1989), therefore CFA is based on past evidence and theory (Brown, 2006). In CFA 
specific hypotheses about the structure of and relations between the latent variables 
are tested (Field, 2009). 

Researchers typically use CFA after an instrument has already been assessed 
using EFA to test if the factor structure produced by EFA fits the data from a new 
sample. An alternative, less typical approach is to perform CFA to confirm a 
theoretically driven item set without the prior use of EFA. However it is stated that a 
CFA that would ultimately need to be followed by a second CFA could be used 
rather than using only a CFA (Worthington and Whittaker, 2006). Thus two CFAs are 
implemented in two different samples in the present research. 

Chi-square (y 2 ), RMSEA, RMR, SRMR, NFI, CFI, and IFI fit values were 
considered to evaluate good fit of the ETSSE scales' sub factors and their relation to 
the overall scale. To identify the reliability, Cronbach's Alpha and McDonald's 
Omega internal consistency coefficients were investigated. In order to identify the 
item discrimination, corrected item total correlation was analyzed. For discriminant 
validity, upper and lower distinct group based t-tests were conducted, and the 
means difference between the upper 27% and the lower 27% were identified. 

Concurrent validity and reliability studies and item analyses were performed 
using the PASW Statistics (formerly SPSS) 18 Software package. The LISREL 8.54 
Software package was used to calculate CFAs. 


Results 


Findings Regarding Validity 

Content validity. A literature review of the ISTE standards for teachers was 
analyzed to specify the extent to which the defined set of items reflects the ETSSE 
content. Next, an item pool containing 86 declarative sentences was designed, taking 
into consideration the studies of Morphew (2012) and Cennamo, Ross, and Ertmer 
(2010) representing ISTE-T (2008) standards and performance indicators. Twenty- 
four sentences were eliminated from the item pool based on lack of clarity, 
questionable relevance, or undesirable similarity to other items. The initial item pool 
with a total of 62 items was presented to 12 experts in the content area to determine 
the content validity. 

Content validity concerns item sampling adequacy - that is, the extent to which a 
specific set of items reflects a content domain (DeVellis, 2003). Usually, an 
instrument's standing with respect to content validity is determined simply by 
having experts carefully compare the content of the test against a syllabus or outline 
that specifies the instrument's claimed domain (Huck, 2012). Croker and Algina 
(1986) claimed that the most commonly used method is to consult expert views in the 
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process of determining content validity (as cited in Kan, 2007), and it is important to 
understand the content consistency among the expert opinions (Yurdugul, 2005). 
While many indexes have been developed to define content validity, Lawshe's (1975) 
content validity ratio (CVR) technique is calculated by quantifying subject matter 
experts' responses to determine "Essential, Useful but not essential, or Not 
necessary" (Lawshe, 1975; Yurdugul, 2005; Kan, 2007). The minimum value of the 
CVR is 0.56 for 12 experts at a .05 level of significance (Lawshe, 1975). 

A total of 22 items were eliminated after the domain experts' assessment. The 
whole content validity indexes of the 40 items and five-sub dimensions of the initial 
scale are as follows: Fl=.80, F2=.72, F3=.80, F4=.75, and F5=.74. The content validity 
indexes of the sub-dimensions are above the minimum value of the CVR. 

Construct validity. Before implementing CFA, the assumptions specified by 
Tabachnick and Fidell (2007) were examined for the datasets of the two CFA groups. 

1. Sample size and missing data. Kass and Tinsley (1979) recommended having 
between five and ten participants per variable, up to a total of 300 participants (as 
cited in Field, 2009). In this research, both the CFA1 group (n=473) and the CFA2 
group (n=394) met this assumption. To assess the factorability of the scale, the 
Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy and Bartlett's test of 
sphericity were used. KMO verified the sampling adequacy for the groups (CFA1= 
.95 and CFA2= .94). The KMO values are above the cut off of .60 as suggested by 
Pallant (2001) and Tabachnick and Fidell (2007). Bartlett's test of sphericity value is 
significant for both CFA1 and CFA2 (CFA1 X 2 = 7335.049, df=780, p< .01; CFA2 X 2 
=8356.177, df= 780, p< .01) as well. There is no missing data in the two datasets. 

2. Linearity and normality. To identify the linearity and normality, a normal p-p 
plot of standardized residual regression and histogram charts were reviewed. 




Figure 1. Normal P-P plot of standardized residual regression and histogram for 
CFA1 
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Figure 2. Normal P-P plot of standardized residual regression and histogram for 
CFA2 

According to the figures, the datasets of CFA1 and CFA2 appear to be both linear 
and normal. In addition to identifying the normality assumption, the relative 
multivariate kurtosis values were reviewed; the values were 1.264 for CFA1 and 
1.206 for CFA2 datasets. According to Kline (1998), multivariate normality kurtosis 
values of < 2 show normality (as cited in A§kar & Mazman, 2013). 

3. Multicollinearity. Moderate to high intercorrelations among the independent 
variables present a problem referred to as multicollinearity (Pedhazur & Schmelkin, 
1991; Stevens, 2009). Some diagnostics of multicollinearity are tolerance and the 
variance inflation factor (VIF). Values below 0.1 indicate serious problems in 
tolerance, and VIF values should be below a value of 10 (Akbulut, 2010; Field, 2007). 
These values were within the appropriate range in both datasets (CFA1: minimum 
tolerance=.38, maximum VIF=1.79; CFA2: minimum tolerance=.28, maximum 
VIF=3.60). 

4. Detecting univariate and multivariate outliers. To identify univariate outliers, 
critical t values (-1.96; +1.96) at a .05 level of significance were investigated, and no 
outliers were found for the two CFA datasets. However, when the Mahalanobis 
distance values were analyzed for CFAl's seven observations of 480 and for CFA2's 
14 observations of 408, these values were identified as exceeding the critical value of 
five independent variables of 20.52 in the multivariate outliers (Tabachnick & Fidell, 
2007). 

As a result of meeting the assumptions of CFA, the two datasets met the criterion 
of implementing CFAs. Consequently, the 473 observations of CFA1 and the 394 
observations of CFA2 were analyzed for construct validity. 

Implementation of the Confirmatory Factor Analyses 

The CFA1 group. The first order analysis of fit indices values for the CFA1 group 
were y 2 (729, n= 473)= 1781.64, p< .001, RMSEA= .055, SRMR= .049, NFI= .95, NNFI= 
.97, CFI= .97, and IFI= .97. A second order confirmatory factor model was formulated 
to show if the five first order factors were indicators of the theoretically proposed 
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higher order factor ETSSE. The resulting analysis of fit indices values were found to 
be x 2 (734, n= 473)= 1857.23, p < .001, RMSEA= .057, SRMR= .053, NFI = .95, 
NNFI=.97, CFI= .97, and IFI= .97. According to the cut-off values indicated in Table 2, 
both the first order and second order CFAs yielded indications of acceptable or good 
fit for the proposed model. All these values for the proposed models of CFA1 group 
indicated that the models are appropriate. 

Table 2. 

The Standard Fit Criteria and Fit Values ofCFAl for the Proposed Model 


Values 

Good Fit Values 

Acceptable Fit 
Values 

1 st order 

CFA 

2 nd order 

CFA 

XV df 

.00 < XVdf < 3 

3.01 < XVdf < 5.00 

2.44 

2.53 

RMSEA 

.00 < RMSEA < .05 

.05 < RMSEA < .08 

.055 

.057 

SRMR 

.00 < SRMR < .05 

.05 < SRMR < .10 

.049 

.053 

NFI 

.95 < NFI < 1.00 

.90 < NFI < .95 

.95 

.95 

NNFI 

.97 < NNFI < 1.00 

.95 < NNFI < .97 

.97 

.97 

CFI 

.97 < CFI <1.00 

.95 < CFI < .97 

.97 

.97 

IFI 

.95 < IFI < 1.00 

.90 < IFI < .95 

.97 

.97 


* 1 st order CFA for CFA1: y 2 =1781.64; df=729; for RMSEA 90% confidence interval = 
(.050, .56) 

When the relationships of the sub factors with general structure of the ETSSE 
model reviewed, the values accordingly found to be as (FI) Facilitating and inspiring 
student learning and creativity =.79, (F2) Designing and developing digital age 
learning experiences and assessments =.90 (F3) Modelling digital age work and 
learning =.96, (F4) Promoting and modelling digital citizenship and responsibility 
=.85 (F5) Engaging in professional growth and leadership =.90. 
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Figure 3. The standardized solution screen of the factor loads of first and second 
order CFA's for the CFA1 group 


The path diagrams of the CFAl's first order and second order models are 
depicted in Figure 3 using a standardized solutions screen. The F3 sub-factor was 
determined to be the most closely related to the ETSSE. When the factor loads of the 
scale were reviewed, the lowest one found to be .46 and the highest .73. 
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The CFA2 group. As a result of the analysis, the first-order fit indices values for the 
CFA2 group were found to be y 2 (727, n= 394) = 1886.31, p<.001, RMSEA= .064, 
SRMR= .056, NFI= .95, NNFI= .97, CFI= .97, and IFI= .97. A second order 
confirmatory factor model was formulated to show if the five first order factors were 
indicators of the theoretically proposed higher order factor ETSSE. As a result, the fit 
indices values were found as y 2 (732, n= 394) = 2362.77, p< .001, RMSEA= .069, 
SRMR= .059, NFI= .95, NNFI= .97, CFI= .97, and IFI= .97. 


Table 3. 

The Standard Fit Criteria and Fit Values ofCFAlfor the Proposed Model 


Values 

Good Fit Values 

Acceptable Fit 
Values 

1 st order 
CFA 

2 nd order 
CFA 

XV df 

.00 < XVdf < 3 

3.01 < XVdf < 5.00 

2.59 

3.23 

RMSEA 

.00 < RMSEA < .05 

.05 < RMSEA < .08 

.064 

.069 

SRMR 

.00 < SRMR < .05 

.05 < SRMR < .10 

.056 

.059 

NFI 

.95 < NFI < 1.00 

.90 < NFI < .95 

.95 

.95 

NNFI 

.97 < NNFI < 1.00 

.95 < NNFI < .97 

.97 

.97 

CFI 

.97 < CFI <1.00 

.95 < CFI < .97 

.97 

.97 

IFI 

.95 < IFI < 1.00 

.90 < IFI < .95 

.97 

.97 


* I®* order CFA for CFA2: y 2 =1886.31; df=727; for RMSEA, the 90% confidence 
interval = (.062, .69) 


According to the cut-off values in the Table 3, both the first and second order 
CFAs yielded indications of acceptable or good fit for the proposed model. All these 
values for the proposed models of the CFA2 group indicated that the models are 
appropriate. 

When the relationships between the sub factors and the general structure of the 
ETSSE model were reviewed, the values were found to be: (FI) Facilitating and 
inspiring student learning and creativity= .72; (F2) Designing and developing digital 
age learning experiences and assessments= .91; (F3) Modelling digital age work and 
learning= .97; (F4) Promoting and modelling digital citizenship and responsibility = 
.84; and (F5) Engaging in professional growth and leadership= .85. The F3 sub-factor 
was found to be the most closely related to the ETSSE. The factor loads of the scale 
ranged from .48 to .75. 
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Figure 4. The standardized solution screen showing factor loads of first and 
second order CFA's for the CFA2 group 

Concurrent validity. In order to identify the concurrent validity of the ETSSE scale, 
the researcher used the Educational Technology Standards Determination Scale 
(ETSS) based on the 2000 ISTE National Educational Technology Standards for 
teachers (NETS-T) developed by Coklar and Odabasi (2009). The ETSS has 41 items 
and six sub-factors and was used in a study with 460 senior level prospective 
teachers in the 2005 and 2006 fall semesters in Turkey. 

Coklar and Odabasi (2009) summarized the ETSS under six sub-factors similar to 
the ISTE NETS-T of 2000. The sub-factors of ETSS are: 1. Technology operations and 
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concepts; 2. Planning and designing learning environments and experiences; 3. 
Assessment and evaluation; 4. Productivity and professional practice; 5. Social, 
ethical, legal, and human issues; and 6. Planning of teaching according to individual 
differences and special needs. 

The ETSSE and the ETSS scales were applied in a study with 114 senior level 
prospective teachers at the same time. The Pearson correlation coefficient calculated 
between the scores of both scales were found to be .83 (p<.01). As a result, a high, 
positive, significant correlation was found between the ETSSE and ETSS scales. Thus, 
the ETSSE scale can be said to provide concurrent validity. 

Findings Regarding Reliability 

Item analysis. The item-total correlation of the ETSSE scale corrected for item 
discrimination was calculated using the Pearson product-moment correlation 
coefficient. 

Table 3. 

The Values of Corrected Item Total Correlation (CITC) for the ETSSE Scale _ 


Sub dimensions 

Item 

CFA1 



CFA 2 



number 







CITC 

a 

00 

CITC 

a 

00 


ml 

.36 



.43 




m2 

.45 



.53 




m3 

.50 



.53 



(1) Facilitating and 

m4 

.48 



.56 



inspiring student learning m5 

.58 

.83 

.83 

.55 

.85 

.85 

and creativity 

m6 

.34 



.37 




m7 

.47 



.45 




m8 

.56 



.42 




m9 

.57 



.61 




mlO 

.58 



.55 




mil 

.58 



.60 




ml 2 

.55 



.67 



(2) Designing and 

ml 3 

.57 



.63 



developing digital age 

ml4 

.63 

.87 

.87 

.63 

.90 

.90 

learning experiences and 

ml 5 

.61 

.67 

assessments 

ml 6 

.51 



.62 




ml 7 

.54 



.62 




ml 8 

.58 



.67 




ml 9 

.54 



.59 




m20 

.46 



.61 



(3) Modelling digital age 
work and learning 

m21 

.59 



.62 



m22 

m23 

.57 

.66 

.77 

.77 

.66 

.65 

.82 

.82 


m24 

.57 



.56 
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Tab 

The 

le 4. (Continued) 

Values of Corrected Item Total Correlation (CITC) for the ETSSE Scale 

Sub dimensions 

Item 

number 

CFA1 


CFA 2 


CITC a 

00 

CITC a 

00 



m25 

.51 


.54 




m26 

.52 


.50 


4) Promoting and 

m27 

60 


66 


modelling digital 

m28 

.40 .78 

.76 

.43 .80 

.80 

citizenship and 

m29 

40 


.40 


responsibility 

m30 

.45 


.46 




m31 

.47 


.48 




m32 

.59 


.59 




m33 

.61 


.63 




m34 

.59 


.62 


(5) Engaging in 

m35 

.52 


.52 


professional growth and 

m36 

.54 .85 

.86 

.49 .89 

.89 

leadership 

m3 7 

.59 


.64 




m38 

.56 


.65 




m39 

.52 


.56 




m40 

.56 


.64 



According to Table 4, the corrected item-total correlations (CITC) of the CFA1 
dataset range from .34 to .66, and the CFA2 dataset ranges from .37 to .67. Generally, 
item total correlation values above .30 are accepted to mean that the item is 
appropriately effective (Buyukozturk, Cakmak, Akgun, Karadeniz & Demirel, 2008). 
Both of these values are above .30, showing that all the items correlate with the total 
score of the scale and are reliable. 


Reliability 

In order to assess the reliability of the scale's internal consistency, both 
Cronbach's Alpha and McDonald's Omega coefficients were calculated. As seen in 
Table 4, the Cronbach's Alpha values for the overall scale and sub-scales ranged from 
.77 to .87, and the McDonald's Omega coefficients ranged from .76 to .87 for the 
CFA1 dataset. For the CFA2 dataset, both the Cronbach's Alpha and the McDonald's 
Omega values ranged from .80 to .90. These results indicate that the internal 
consistency and reliability of the composite and sub-scales were adequate. 

Another technique used to determine reliability is to identify differences in the 
arithmetic means of the scores with high or low self-efficacy levels. Differences in the 
mean scores of the upper and lower 27% groups can be reviewed for the discriminant 
validity (Atilgan, Seckes, Yurdugul & Cirak, 2007). For discriminant validity, upper 
and lower distinct group based t-tests were conducted, and the results are presented 
in Table 5. 
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Table 5. 

Discriminant Validity, Upper and Lower 27% Distinct Groups-Based Independent Samples 
t-test Scores 


Factors 

Group 

CFA1 




CFA2 



n 

X 

Sd 

df 

t P 

n 

X 

Sd 

df t p 

FI 

Lower 

128 

3.39 

.21 

254 

44.04 .00 

106 

3.17 

.30 

210 -31.59 .00 


Upper 

128 

4.69 

.26 




4.46 

.30 


F2 

Lower 

128 

3.21 

.31 

254 

-41.55 .00 

106 

2.94 

.36 

210 -32.47 .00 


Upper 

128 

4.58 

.21 




4.39 

.29 


F3 

Lower 

128 

3.17 

.34 

254 

-41.84 .00 

106 

2.98 

.32 

210 -37.29 .00 


Upper 

128 

4.65 

.33 




4.48 

.26 


F4 

Lower 

128 

3.06 

.35 

254 

-42.48 .00 

106 

2.95 

.34 

210 -34.61 .00 


Upper 

128 

4.57 

.20 




4.43 

.28 


F5 

Lower 

128 

3.28 

.34 

254 

-40.49 .00 

106 

3.02 

.32 

210 -36.33 .00 


Upper 

128 

4.68 

.19 




4.46 

.25 


ETSSE 

Lower 

128 

3.35 

.25 

254 

-43.85 .00 

106 

3.13 

.27 

210 -34.67 .00 


Upper 

128 

4.52 

.17 




4.32 

.22 



According to the independent samples t-test results, the self-efficacy scores of the 
upper and lower 27% groups in either CFA1 or CFA2 were significantly different for 
all sub-scales and total scales at.01. Thus these results provide adequate evidence for 
the discriminant validity. 


Discussion and Conclusion 

Of the existing literature on ISTE standards, Coklar's (2008) research about the 
ISTE NETS-T 2000 standards and performance indicators is an important resource. 
Of the other researchers, Misirli (2014) studied standards for students, Caglar (2012) 
studied standards for teachers, and Hacifazlioglu, Karadeniz, and Dalgic (2010) 
studied standards for administrators. Besides, Kabakci Yurdakul et al. (2014) 
determined teacher competencies in technopedagogical education in terms of 
national standards; the study listed 20 competencies and 120 performance indicators 
with a group of 24 faculty members. Despite the important and significant previous 
research on standards for teachers or other groups in Turkey, more studies 
specifying educational technology skills similar to ISTE or UNESCO ICT 
competencies will contribute to identifying national educational technology 
standards. These standards should also be developed in accordance with valid 
pedagogical and technological improvements. 

The ETSSE scale presents a valid measurement system based on the 
contemporary ISTE standards for teachers. The standards are differentiated from the 
previous ISTE NETS-T in terms of highlighting creativity and innovation (Orhan, 
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Kurt, Ozan, Som Vural & Turkan, 2015). These standards have a constructivist focus, 
attach importance to globalization and cultural awareness, reflect changing 
perspectives, and require teachers to demonstrate leadership (Willis, 2012). 
Kadijevich and Haapasalo (2008) emphasized the importance of examining relevant 
variables concerning educational technology standards (behavior, intention, interest, 
attitude, support, experience, etc.) using multiple sources of evidence and combining 
qualitative and quantitative aspects. For these reasons, this scale is an important data 
gathering tool to reveal teachers' and prospective teachers' educational technology 
self-efficacy within the context of creativity, collaboration, innovation, and 
globalization, which are considered important competences in modern education 
frameworks. 

Two different study groups were analyzed in this study: prospective teachers 
studying in various departments and different teacher training programs, and 
current teachers from 34 different branches having between 1 and 20 years of 
teaching experience. Therefore, the study was carried out within different 
populations of pre-service and in-service teachers. 

The ISTE standards and performance indicators were constructed by 
internationally known education technology specialists (ISTE, 2000; ISTE, 2014), and 
the standards are included in a theoretically driven model updated by new research 
on technology use in education. Therefore, regardless of exploratory factor analysis, 
only CFA procedures were analyzed in this study. Segars and Grover (1993) allege 
that, as more is known about the theoretical and measurement properties of scales 
and their underlying constructs, methods for empirically evaluating these 
associations should evolve from exploratory classical techniques to more exact and 
confirmatory contemporary techniques. Because this study tests the ISTE standards 
in Turkish pre-service and in-service teachers, the formulation of the standards is a 
prerequisite for the application of CFA (Pedhazur & Schmelkin, 1991). However, 
Worthington and Whittaker (2006) stated that, rather than producing a CFA that 
would ultimately need to be followed by a second CFA, two CFAs should be 
implemented in two different study groups. 

Consequently, the study examines the factor structure of the ETSSE scale via two 
different CFAs. The first and second order CFAs of the two datasets confirmed the 
structures by the fit values of two construct validity implementations. The structures 
are valid in terms of content, construct, concurrence, and discriminant validity and 
reliable in terms of corrected item total correlation, Cronbach's Alpha, and 
McDonald's Omega. This tool can be also utilized to assess the self-efficacy levels of 
teachers or prospective teachers at various educational institutions. 
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Appendix 

Education Technology Standards Self-Efficacy (ETSSE) Scale 



Tamamen 

Katiliyorum 

Katiliyorum 

Biraz Katiliyorum 

Katilmiyorum 

Tamamen 

Katilmiyorum 

^ Teknolojiyi, ogrencilerin yaratici du§iinmelerini 

geli§tirmeleri iqin kullanabilirim. 






Ger^ek ya§am problemlerini gozmede; dijital araglarm 

2. nasil kullamlabilecegi konusunda ogrencileri 

yonlendirebilirim. 






^ Ogrencileri, qe§itli dijital ogrenme ortamlarina 

katilmalari iqin te§vik edebilirim. 






^ Ogrenmeyi kolayla§tirma konusunda, ogrencileri 

teknolojik araqlan kullanmaya te§vik edebilirim. 






Dijital araqlari ve kaynaklan kullanarak ogrencilerin 

5. gergek ya§amla ilgili konulan ara§tirmalarina rehberlik 

edebilirim. 






^ Belirli bir konudaki problemi qbzmeleri iqin ogrencileri 

internette ara§tirma yapmaya yonlendirebilirim. 






Ogretim stirecinde, teknoloji destekli ileti§im 

7. ortamlarmdan (blog, forum, sohbet, e-posta vb.) 

yararlanabilirim. 






g Ogrencilerin birbirleriyle etkile§ime girmeleri igin ge§itli 

dijital ortamlari kullanmalanm saglayabilirim. 






Ogrencilerin, bilgi ve ileti§im teknolojisi araglarim 

9. i§birlikli ogrenme igin kullanmalarma rehberlik 

edebilirim. 






Ogrencilere bireysel geli§imlerini aktif bir bigimde 

10. izleyebilecegi teknolojiyle zenginle§tirilmi§ ogrenme 
ortamlari olu§turabilirim. 






Ogrencilerin kalici bir biqimde ogrenmesini saglamak 
igin konu alamyla ilgili dijital arag ve kaynaklari 
biitunle§tirerek uygun ogrenme etkinlikleri 
tasarlayabilirim. 






Ogrencilerin yaratici du§unmelerini desteklemek igin 
^2 konu alamyla ilgili dijital arag ve kaynaklan 

biitiinle§tirerek uygun ogrenme etkinlikleri 
tasarlayabilirim. 






Bilgi ve ileti§im teknolojilerini kullanarak farkli 

13. deneyimlere sahip ogrenciler igin uygun ogrenme 
ortamlari hazirlayabilirim. 






Ogrencilerin farkli ogrenme ihtiyaglarmi daha etkili 

14. desteklemek iqin teknolojiyle zenginle§tirilmi§ ogretim 
stratejilerini uygulayabilirim. 






Ogrencilerin ogrenme diizeylerini degerlendirmek igin 
teknolojiyi etkili bir §ekilde kullanabilirim. 






Ogrenme-ogretme siirecinin iqinde ve sonunda alternatif 
16. degerlendirme yontemlerini kullamrken teknolojiden 
yararlanabilirim. 






yj Teknolojik araglari, ogretim siireci ile ilgili her tiirlii 

verileri i§lemek ve raporla§tirmak igin kullanabilirim. 






Ogretim siireci igin en uygun teknolojiyi/teknolojileri 
segebilirim. 
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Ogrenme-ogretme stirecinin gergekle§tirilecegi ortairu 
teknoloji kullammina uygun olarak diizenleyebilirim. 






Ktiresel toplumun bir iiyesi olarak yenilikgi bir 

20. ogretmenin sahip olmasi gereken tutumlari 
sergileyebilirim. 






22 Bili§im teknolojileri ile ilgili yazilim ve donanimlari 

etkili bir bigimde kullanabilirim. 






22 Sahip oldugum teknoloji bilgimi yeni teknolojilere, etkili 

bir bigimde transfer edebilirim. 






Ogrencilerin ula§tigi bilgi kaynaklarim dogru bigimde 

23. kullanmalari igin dijital araglarin etkili bigimde 
kullanilmasma rehberlik edebilirim. 






Daha etkili bir ogretmen olabilmek igin yeni teknolojik 

24. araglar konusunda siirekli olarak kendimi 
geli§tirebilirim. 






2 ^ bilgi ve ileti§im teknolojileri ile ilgili yasal 

sorumluluklari bilirim. 






2 ^ bilgi ve ileti§im teknolojileri ile ilgili ahlaki 

sorumluluklari ogrencilere kazandirabilirim. 






Ogrenme-ogretme siirecinde, ogrencileri gtivenilir dijital 
27. kaynaklara yonlendirerek dogru bilgiye ula§malari igin 
onlara rehberlik edebilirim. 






2 g Bili§im teknolojilerini kullamrken lisansli yazilimlar 

kullanmaya ozen gosteririm. 






2 g Dijital kaynaklari kullamrken telif hakki konusunda 

hassas davranirim. 






2 q Sanal sosyal aglan kullamrken ogrencileri dti§unerek 

onlara model olabilecek bigimde davranabilirim. 






22 bilgi gaginin ileti§im araglarmi kullanarak farkli 

kiiltiirlerden ogretmenlerle ileti§ime gegebilirim. 






32. bilgi ve ileti§im teknolojilerindeki yenilikleri izlerim. 






Mesleki geli§imimi desteklemek igin bilgi ve ileti§im 
teknolojilerinden yararlanabilirim. 






22 Teknoloji kaynaklarim ya§am boyu ogrenen bir birey 

olmak igin kullanabilirim. 






Ogretmenlik becerilerimi geli§tirmek igin gevrim igi 

22 ortamlarda (forumlar, video konferanslar, sanal sosyal 

aglar vs.) ogretmenlerle bilgi ali§veri§inde 
bulunabilirim. 






Ulusal ve uluslararasi topluluklara katilarak 

36. ogrencilerin ogrenmesine katki saglayacak etkili 
teknoloji uygulamalarim inceleyebilirim. 






2 y Meslegimde kendimi geli§tirmek igin dijital arag ve 

kaynaklari etkili bigimde kullanabilirim. 






2 g Teknolojinin egitimde etkili bir bigimde kullamlmasi 

igin meslekta§larima onciiliik edebilirim. 






Mesleki geli§imimi saglamak igin meslekta§larimla e- 
39. posta gruplari ya da sanal sosyal gruplar 
olu§turabilirim. 






Meslegim ve konu alamm ile ilgili yapilan ara§tirmalari 

40. inceleyerek bunlari, ogrencilerin ogrenmesine katki 
saglamasi igin kullanabilirim. 
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Distribution of the items in terms of the sub factors 

1. Facilitating and inspiring student learning and creativity: 1-9 items 

2. Designing and developing digital age learning experiences and assessments: 10-19 

items 

3. Modelling digital age work and learning: 20-24 items 

4. Promoting and modelling digital citizenship and responsibility: 25-31 items 

5. Engaging in professional growth and leadership: 32-40 items 


Egitim Teknolojisi Standartlarma Yonelik Oz-Yeterlik Olcegi 
(ETSYO): Gecerlik Giivenirlik Cahsmasi 


Ataf: 

Simsek, O., & Yazar, T. (2016). Education technology standards self-efficacy (ETSSE) 
scale: A validity and reliability study. Eurasian Journal of Educational Research, 
63, 311-334, http://dx.doi.org/ 10.14689/ejer.2016.63.18 


Ozet 

Problem Durumu: Yakm gelecekte, diger bazi alanlarda oldugu gibi egitim alanmda 
da, uluslararasi standartlarda egitim veren kaliteli okul ve tiniversiteler; kalitesiz 
olan ve gaga ayak uyduramayan kurumlarm yerini alacaktir (Ozcan, 2013). 21. yiizyil 
becerilerinin ne olmasi ile ilgili ulusal ve uluslararasi dtlzeyde yapilan gali§malar 
ogrencilerde, ogretmenlerde ve yoneticilerde bulunmasi gereken ozellikleri 
standartlar bigiminde ifade ederken bilgi ve ileti§im teknolojilerini etkin bigimde 
kullanma becerisinin temel beceriler arasmda oldugu belirtilmi§tir (Voogt ve Roblin, 
2010 ). 

ISTE'nin yayimladigi 2008 Uluslararasi Egitim Teknolojisi Standartlarma gore 
ogretmenler; dijital gagm ogrenme deneyimlerini tasarlayarak ogrencilerin 
ogrenmelerini kolayla§tiran ve yaratici du§unmelerini te§vik eden, dijital gagm 
gali§ma anlayi§ma onciiltik eden, bir dijital vatanda§m sahip oldugu sorumluluklari 
bilen ve okul iginde ya da di§inda mesleki geli§im ve liderlik etkinliklerine katilan, 
yirmi birinci yilzyil becerisi sergileyen bireylerdir. 

Bu ara§tirmanm amaci, ISTE tarafmdan ogretmen ve ogretmen adaylari igin en son 
belirlenen (2008) uluslararasi egitim teknolojisi standartlarinm be§ boyutlu yapismm 
Dogrulayici Faktor Analizi(DFA) ile test etmek ve Egitim Teknolojisi Standartlarma 
Yonelik Ozyeterlik (ETSYO) olgegini geli§tirmektir. 
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Ara§tirmanin Yontemi: Ara§tirmanm olgek geli§tirme stirecinde segilen gali§ma 
gruplanm; 2014-2015 ogretim yilirun bahar doneminde Dicle Universitesi Ziya 
Gokalp Egitim Fakliltesi'nin ogrenim goren ogretmen adaylari ve Diyarbakir ili 
merkez ilgelerinde bulunan ortaokul ve lise ogretmenleri olu§turmaktadir. Veriler 
ogretmen adaylari (DFA1; n=473) ile ogretmenler (DFA2; n=394) olmak ilzere iki 
farkli gruptan toplanmi§tir. Ara§tirmada olgegin kapsammi belirlemek igin oncelikli 
olarak ISTE-T (2008) standartlari ve performans gostergeleri ve agiklamalan 
incelendikten sonra bu standartlari agiklayan Morphew (2012) ve Cennamo, Ross ve 
Ertmer'in (2010) gali§malari da goz ontinde tutulmu§ ve alan uzmanlarinm 
degerlendirmesi igin 62 maddelik bir anket formu olu§turulmu§tur. 12 katilimci 
uzmanm gorti§lerini belirttigi kapsam gegerlik oranlari(KGO) hesaplanmi§tir. KGO 
hesaplandiktan sonra 40 maddelik bir pilot olgek hazirlanmi§tir. ETSYO olgeginin alt 
boyutlan, (1) Ogrencilerin ogrenmelerini kolayla§tirma ve yaraticiligi te§vik etme (2) 
Dijital gaga uygun ogrenme ortamlari ve degerlendirme etkinlikleri tasarimlama ve 
geli§tirme (3) Dijital gagm gali§ma ve ogrenme anlayi§ma onctiltik etme (4) Dijital 
vatanda§likta model olma (5) Mesleki geli§im ve liderlik etkinliklerine katilma 
§eklindedir. 

Arajjtirmada, Hem DFA1 hem de DFA2 grubu igin DFA'nm uygulanmasmdan once 
Tabachnick ve Fidell (2007) tarafmdan belirtilen sayiltilara gore veri setleri 
incelenmi§tir. Orneklem ve kayip veri, dogrusallik ve normallik, goklu baglantililik 
ve aykiri gozlemler on ko§ullari incelendikten sonra ogretmen ve ogretmen adaylari 
igin iki farkli dogrulayici faktor analizi uygulanmi§tir. 

Ara$tirmanin Bulgulan: DFA1 igin birinci dtizey DFA bulgulan [y 2 (729, N = 473) = 
1781.64, p < .000, RMSEA=.055, S-RMR=.049, NFI = .95, NNFI=.97, CFI=.97, IFI=.97] 
kurulan modelin kabul edilebilir uyum gosterdigini ortaya koymaktadir. ETSYO'nun 
alt olgekleri ile tek bir yapiya yonelip yonelmediginin belirlenmesi igin DFA1 
grubunun veri seti ile ikinci dtizey DFA uygulanmi§ ve bulgulara gore ETSYO'ntin 
genel yapisi da kabul edilebilir uyum gostermi§tir [y 2 (734, N = 473) = 1857.23, p < 
.000, RMSEA=.057, S-RMR=.053, NFI = .95, NNFI=.97, CFI=.97, IFI=.97], 

DFA2 igin birinci dtizey [y 2 (727, N = 394) = 1886.31, p < .000, RMSEA=.064, S- 
RMR=.056, NFI = .95, NNFI=.97, CFI=.97, IFI=.97]; ikinci duzey [y 2 (732, N = 394) = 
2362.77, p < .000, RMSEA=.069, S-RMR=.059, NFI = .95, NNFI=.97, CFI=.97, IFI=.97] 
§eklindedir ve bu sonuglar olgegin kabul edilebilir oldugunu gostermektedir. 

ETSYO olgeginin uyum gegerligini ortaya koymak igin ((ioklar ve Odaba§i (2009) 
tarafmdan geli§tirilen Uluslararasi Egitim Teknolojileri Birligi'nin ogretmen ve 
ogretmen adaylari igin belirledigi Ulusal Egitim Teknolojisi Standartlarmi (2000) 
temel alan Ogretmenlere Yonelik Egitim Teknolojisi Standartlarmi Belirleme Olgegi 
(ETSO) kullanilmi§tir. ETSYO ve ETSO 114 ki§ilik bir gruba uygulanmi§tir. Her iki 
olgekten alman puanlar arasmda hesaplanan korelasyon katsayisi .83 (p<.01) olarak 
bulunmu§tur. ETSYO olgegi ile ETSO arasmda ytiksek dtizey de, pozitif ve anlamli 
bir ili§ki oldugu belirlenmi§tir. 

ETSYO Olgeginin madde ayirt ediciligi igin dtizeltilmi§ madde-toplam korelasyonu 
hesaplannu§tir. DFA1 ve DFA2 gruplari ile gergekle§tirilen goztimlemelerde madde 
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toplam korelasyonuna ili§kin degerlerin .34 ile .67 arasmda degi§tigi gorlilmu§tur. 
Olgegin giivenirligine ili§kin bulgularm incelenmesi igin hem Cronbach Alpha hem 
de McDonald (Omega) katsayisi degerlerine bakilnn§ ve Cronbach Alpha degerleri 
turn olgek igin .95, l.boyut=.83; 2.boyut=.87; 3.boyut=.77; 4.boyut=.78; 5.boyut=.85 
gikmi§tir. McDonald'm Omega katsayisi incelendiginde turn olgek igin .96, 
l.boyut=.83; 2.boyut=.87; 3.boyut=.77; 4.boyut=.76; 5.boyut=.86 gikmi§tir. Ayrica, her 
bir alt olgegin ve birle§ik olgegin (ETSYO) olgtiigii egitim teknolojisi standartlan oz 
yeterlik boyutlarmdaki %27'lik alt ve %27'lik list gruplarm puan ortalamalari 
arasmdaki farklarm istatistiksel olarak anlamli oldugu gorulmu§tur. 

Ara§tirmanm Sonuglan ve Onerileri: Alanyazmda ISTE'nin egitim teknolojisi 
standartlan ya da UNESCO'nun BIT yeterlikleri gergevesi ile ilgili gali§malarm yeterli 
olmadigi soylenebilir. Zira, egitim teknolojisi standartlan uluslararasi katilimcilar 
tarafmdan silrekli geli§tirildikleri igin gtincel gali§malarm yapilmasma gereksinim 
vardir. Kadijevich ve Haapasalo (2008) da egitim teknolojisi standartlarmm 
(davram§, isteklilik, ilgi, tutum, destek, deneyim vs.) ge§itli kanitlara dayali 
kaynaklar kullanarak niteliksel ve niceliksel bigimde incelenmesi gerektigini 
vurgulami§tir. Bu ara§tirmada geli§tirilen olgek ISTE'nin 2008 yilmda ortaya 
koydugu ogretmen standartlarmi ve performans gostergelerini dikkate aldigi igin 
daha gtincel bir baki§ agisi ortaya koymaktadir. ISTE NETS-T (2000) standartlarmdan 
farkli olarak 2008 yilmdaki standartlarm yaraticilik ve yenilikgilik vurgusu yaptigi 
(Orhan, Kurt, Ozan, Som Vural ve Tiirkan, 2015), yapilandirmaci yakla§ima dayali 
oldugu ve mesleki ya§amda kiireselle§me ve kultiirel farkmdaligm geli§tirilmesine 
onem verdigi gortilmektedir (Willis, 2012). Bu nedenle, ogretmen ve ogretmen 
adaylari igin uluslararasi egitim teknolojisi standartlan (ISTE-T) baglammda 
geli§tirilen bu olgek, 21. ytizyil ogretmen dzelliklerini yaraticilik, i§birligi ve 
yenilikgilik baglammda incelemek igin onemli bir veri toplama aracidir. Bu maddeler 
ve boyutlar deneysel ve tarama modellerinde kullamlarak egitimsel ara§tirmalara 
katki saglayacaktir. Hem ogretmen adaylari hem de ogretmenler ile gergekle§tirilen 
bu gali§mada iki grup igin dogrulayici faktor analizinin yapilmasi ve gegerlik - 
gtivenirlik sonuglarmm istatistiksel olarak anlamli gikmasi nedeniyle ETSYO olgegi 
alt boyutlan ve birle§ik olgek olarak kullamlabilecegini gostermektedir. 

Anahtar Sozcukler: Egitim teknolojisi standartlan, ISTE standartlan, olgek geli§tirme, 
dogrulayici faktor analizi 



